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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 . 1 36(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1 )£3 Responsive to communication(s) filed on 17 November 2003 . 
2a)E3 This action is FINAL. 2b)D This action is non-final. 

3) Q Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quay/e, 1935 CD. 1 1, 453 O.G. 213. 

Disposition of Claims 

4) ^ Claim(s) 1-20 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) E] C\a\m{$) 1^20 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1 .121(d). 

1 1) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 
Priority under 35 U.S.C. §§ 119 and 120 

1 2) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 1 9(a)-(d) or (f). 

a)D All b)Q Some*c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2. Q Certified copies of the priority documents have been received in Application No. . 

3. Q Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

13) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 1 19(e) (to a provisional application) 

since a specific reference was included in the first sentence of the specification or in an Application Data Sheet. 
37 CFR 1.78. 

a) □ The translation of the foreign language provisional application has been received. 

14) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121 since a specific 

reference was included in the first sentence of the specification or in an Application Data Sheet. 37 CFR 1 .78. 



4) C] Interview Summary (PTO-413) Paper No(s). 

5) □ Notice of Informal Patent Application (PTO-152) 

6) □ Other: 



Attachment(s) 

1) □ Notice of References Cited (PTO-892) 

2) (Zl Notice of Draftsperson's Patent Drawing Review (PTO-948) 

3) El Information Disclosure Statement(s) (PTO-1449) Paper No(s) 5,_7 . 
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DETAILED ACTION 



Information Disclosure Statement 



1. The information disclosure statement (IDS) submitted on 11/17/03 and 12/01/03 
have been considered by the examiner. 



2. The formal drawings submitted on 1 1/24/03 have been received and made of 
record in the file. 



3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as 
set forth in section 102 of this title, if the differences between the subject matter sought to be 
patented and the prior art are such that the subject matter as a whole would have been obvious 
at the time the invention was made to a person having ordinary skill in the art to which said 
subject matter pertains. Patentability shall not be negatived by the manner in which the invention 
was made. This application currently names joint inventors. In considering patentability of the 
claims under 35 U.S.C. 103(x), the examiner presumes that the subject matter of the various 
claims was commonly owned at the time any inventions covered therein were made absent any 
evidence to the contrary. Applicant is advised of the obligation under 37 CFR 1 .56 to point out the 
inventor and invention dates of each claim that was not commonly owned at the time a later 
invention was made in order for the examiner to consider the applicability of 35 U.S.C. 103(c) and 
potential 35 U.S.C. 102(e), (f) or (g) prior art under 35 U.S.C. 103(a). 



4. Claims 1-20 are rejected under 35 U.S.C. 103(a) as being unpatentable over 



Drawings 



Claim Rejections - 35 USC § 103 



Zilles et al. (U.S. Patent No. 6,1 1 1 ,577). 
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With reference to claims 1, 3, 4, 6, 7, 11, 12, and 15-17, Zilles teaches a method and 
apparatus for determining forces to be applied -to a user through a haptic interface, 
wherein in one embodiment the step of generating a representation of an object in 
graphic space includes defining the object as a mesh of planar surfaces and associating 
surface condition values to each of the nodes defining the planar surfaces. In another 
embodiment, the step of generating a representation of an object in graphic space 
includes describing the surface of the object using a coordinate system and associating 
surface condition values with each set of coordinates of the coordinate system (see 
abstract). The computer system, includes a processor, a user input device and a display 
device (see column 18, lines 45-56), generating a computer generated geometric model 
of the virtual object (see column 4, lines 15-26), and a haptic interface operatively in 
communication with the computer system, wherein the haptic interface includes a haptic 
device for transmitting information between a user and the geometric model (see 
column 6, lines 3-22), and wherein a haptic device position and orientation are acquired 
with respect to a surface of the geometric model (column 15, lines 60-64), and mapped 
into a geometric model coordinate reference system (see column 17, lines 30-38), a 
closest point position and orientation on the surface of the geometric model to the haptic 
device position is determined (see column 17, lines 39-50), a surface property at the 
closest point position and orientation is extracted (see column 17, line 60-column 18, 
line 5), and a property-feedback force is determined and applied to the haptic device to 
the hand of the user in relation to the surface of the geometric model (see column 18, 
lines 43-47). 
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Zilles fails to specifically teach that the system includes a memory, however it 
would be inherent that a computer system has a memory device. Furthermore, in a 
system as taught by Zilles it would be necessary for there to be a memory device to 
store the haptic sensations, geometric representations of the real object, software 
programs, algorithms for calculating force, and the coordinate system. Even though 
Zilles et al. fails to specifically teach generating a stick-to-surface force, there is 
disclosure teaching the application of different surface "feels", as well as the usage of a 
stiffening force applied on a virtual object surface (see column 6, lines 44-68). 
Furthermore, with the proper usage of detecting the haptic interface point in graphic 
space in combination with algorithms, or impedance control techniques carried out by 
the haptic rendering application it would be obvious to one skilled in the art to generate 
a stick-to-surface force, just as any other surface force or "feel", i.e., smoothing, bumps, 
concaved, solid, flexible. 

Therefore it would have been obvious to one having ordinary skill in the art at the 
time of the invention to allow the device of Zilles to include the memory device as 
explained above, and have the ability to generate a stick-to-surface force in order to 
provide a haptic interface system which provides touch interfaces which accurately 
replicate the touch sensations a user would experience in the real world and thereby 
allowing the virtual object to "feel" more realistic. 
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With reference to claims 2, 13, 14 and 20, Zilles teaches the usage of a display 
(150) wherein the object is represented in graphic space and describes a virtual 
environment using a coordinate system (see column 17, lines 30-32). 

With reference to claim 5, Zilles fails to teach the usage of a memory, however it 
would be inherent for such a device to include a memory as explained above with 
reference to claim 1 . Zilles further teaches that CAD software is used to generate the 
representation of the object (see column 4, lines 313-35). After generation a 
representation of the object in graphic space (step 10), the sensors of the haptic 
interface system sense the position of the user in real space (step 12). 

With reference to claims 8, 9, 10, 18, and 19, it is taught that one of many types 
of planar surface and shapes can be used in forming the virtual object (see column 15, 
lines 40-56), which would allow for determining a surface curvature at the closest point 
position and orientation. It is also taught determining a surface normal (see column 16, 
lines 56-62). Further it is taught that after defining the positions of nodes (A-C) on the 
planar surface, the interpolation scheme is used for converting the detected position into 
a vector (see column 16, lines 18-25). 
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Response to Arguments 



5. Applicant's arguments filed 1 1/17/03 have been fully considered but they are not 
persuasive. It is argued that Zilles et al. does not disclose a haptic device for 
transmitting information between a user and a geometric model wherein a haptic device 
position and orientation are acquired with respect to a surface of the geometric model 
and mapped into a geometric model coordinate reference system. However, Zilles et al. 
teaches that the haptic rendering application describes the real world object using a 
coordinate system (see column 5, lines 58-59), wherein the application has generated a 
representation of an object in graphic space and the haptic interface device senses the 
position of the user in real space. After the haptic interface device has sensed the 
position of the user in real space, the information regarding the position of the user is 
relayed to the haptic rendering application. The haptic rendering application uses the 
position of the user in real space to determine the location of the haptic interface point in 
graphic space. As the user changes position, the haptic interface device senses this 
change in position and the haptic rendering application updates the location of the 
haptic interface point in graphic space to reflect the change of the user's position in teal 
space (see column 6, lines 3-22). It is argued that Zilles et al. does not disclose a 
closest point position and orientation on the surface of the geometric model to the haptic 
device position is determined, and a surface property of the geometric model at the 
closest point position and orientation is extracted. However, Zilles et al. teaches that the 
closest point position and orientation on the surface of the geometric model to the haptic 
device position is determined by usage of the coordinate system of the virtual 
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environment defined by the haptic rendering application. The haptic rendering 
application describes a planar surface (130) of the virtual object using a rectangular 
coordinate system, which can be mapped into the (x, y t z) coordinate system. With 
reference to the surface property of the geometric model at the closest point position 
and orientation, which is extracted, Zilles et al. teaches a texture map to be applied to 
the planar surface defined by a third coordinate system having u and v axes, wherein 
the texture map represents the texture to be assigned to the planar surface. A series of 
transformation equations maps the coordinates (s, t) of the planar surface to the 
equivalent coordinates (u, v) of the texture map (see column 17, line 30-column 18-line 
39). It is also argued that Zilles et al. fails to teach a stick-to-surface force and a 
property-feedback force are determined and applied to the haptic device to constrain a 
hand of a user to the surface of the geometric model. However, as explained above, 
even though Zilles et al. fails to specifically teach generating a stick-to-surface feel for 
constraining the users hand to the surface of the virtual object it would be obvious to 
one having ordinary skill in the art to generate such a surface feel by usage of 
algorithms in the haptic rendering application. It is well known in the art generating 
barrier forces, stiffening forces, resistive forces, magnetic forces, or the like all of which 
could result in providing a feedback "feeling" of constraining the hand of the user to a 
surface or within an area being displayed. In a virtual environment wherein a barrier 
force is applied it prevents the users hand from passing, a certain surface or area 
thereby constraining the hand of the user within an area being displayed; a stiffening 
force or a resistive force applied in a virtual environment the movement of the haptic 
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device is stiff and restrictive, or resisting movement of the users hand within the area of 
the virtual environment in which the force is applied; a magnetic force applied in a virtual 
environment will provide a magnetic force between the virtual representation of the 
haptic device and a virtual surface which would also simulate a force constraining the 
virtual representation of the haptic device to the virtual surface. Therefore the rejection 
to the claims 1-20 will be maintained. 

Conclusion 

6. THIS ACTION IS MADE FINAL Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 . 1 36(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Alecia D. Nelson whose telephone number is (703) 305- 
0143. The examiner can normally be reached on Monday-Friday 9:30-6:00. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Steve Saras can be reached on (703) 305-9720. The fax phone number for 
the organization where this application or proceeding is assigned is (703) 872-9306. 

Any inquiry of a general nature or relating to the status of this application or 
proceeding should be directed to the receptionist whose telephone number is 703-305- 
2600. 



/far rfdhtyfyw^ 



adn/AND ^ 2oo V 

January 9, 2004 



